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Abstract. A presentation of numerical range for rectangular matrices 
is undertaken in this paper, introducing two different definitions and 
elaborating basic properties. Then we are extended to the treatment of 
rank-k numerical range. 
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1 Introduction 

Let A^m,n(C) be the set of matrices A = [aij^jl^ with entries aij E C. For 
m = n, the set 

(1.1) F(^) = {xMx : x G C", ||x||2 = 1} 

is the well known numerical range or field of values of A, for which basic 
properties can be found in [TT], [H] and chapter 22]. Equivalently, we 
say that F{A) = f{Sn), where 5„ is the unit sphere of C" and the function 
/ on Sn is defined by the bilinear mapping 5 : 5„ x 5„ ^ C, such that 
f{x) = g{x,x) = x*Ax. It is remarkable that F{A) is closed and convex set 
and contains the set of eigenvalues of A. 

For m n, the motivation herein is to investigate "how the numerical 
range w(A) can be defined for a rectangular matrix A " based on the inner 
product and to develop some basic and fundamental properties. As we may 
see, the results vary and the approach is undertaken in two ways, firstly we 
consider a natural extension of (jl.ip and on the other hand, introducing the 
idea of restriction or extension of dimensions of A, we are led to the rela- 
tionship of w{A) with the numerical range of square matrices via projection 
matrices. Hence, generalizing the notion of definition (11. ip . we consider the 
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bilinear mapping g : Sn x Sm C, g{x,y) = y*Ax, which gives rise to the 
numerical range of m x n matrix A, as the set 

(1.2) w{A) = {y*Ax : x E C",y e C'", ||x||2 = ||y||2 = 1} 

which is equal to g{Sn x Sm)- Note that for m > n we have 



Fi[A a 



mx (m— n) J 



y*Ax : y 



y*A- 



\x\\ 



, X G 



> \\y\\2 = 
\xe e 



1 



c w{A). 

Proceeding, it is proved that ^^{A) is identified with the circular disc 
{z G C : \z\ < 11^112}) since the unit vectors x and y belong to different 
dimensional spaces. An approximation of w{A) from within, following, is 
shown, assuming that the vectors x, y in (|1.2p belong to subspaces J- C 
and G C C™", respectively. Recently, has been proposed ^ as numerical 
range of A E M.m,n with respect to matrix B G M.m,n the compact and 
convex set 



(1.3) w\\.\\{A,B)= fl {zG 

20 gc 



zol < \\A-zoB\\}. 



The (|1.3|) is an extension of definition of F{A) for square matrices in P] and 
clearly the numerical range, as in [T], [2], is based on the notion of matrix 
norm. In [7] has been proved that (^4, i?) coincides with the disc 



(1.4) 



z G C 



{A,B) 
WBf 



< \\A 



{A,B) 
WBf 



Bh 1 



\B 
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when ||i?|| > 1 and the matrix norm ||-|| is induced by the inner product (•,•). 
The complicated formulation of numerical range of A and the necessity of 
independence of w^^.^^{A, B) by the matrix B in (jl.Sp and (jl.4p . are signified 
in section 2. 

Another proposal for the definition of numerical range for rectangular 
matrices, which will be further exploited in section 3, is the projection onto 
the lower or the higher dimensional subspace. Let m > n and the vectors 
vi, . . . ,Vn of C" be orthonormal basis of C"'. Clearly, the matrix P = HH* , 
where H = ^ vi ... t;„ ] , is an orthogonal projector of C" — > C". In 
this case, for A G Aimn, we define with respect to H: 



(1.5) 



wiiA) = F{H*A) 



where obviously H* A is n x n matrix. Moreover, the vector y = Hx G C" 
is projected onto C" along /C, where KL is any direct complement of C", i.e. 
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= C"e/C. Since, ||y|| = {x*H*Hxf/'^ = \\x\\, instead of ((TS]), it can also 
be provided a treatment of the numerical range Wh{A) of higher dimensional 
m X m matrix AH* , namely, 

(1.6) Wh{A) = F{AH*). 
Similarly, if m < re, then x = Hy and consequently 

(1.7) wi{A) = FiAH), WhiA) = FiHA). 

Apparently, by ()1.5p - ()1.7p . the numerical range of A E M.m,n via the 
projection of unit vectors onto C"" or C™ is referred to the numerical range 
of square matrix, indicating obviously the convexity of wiiA) and WhiA). 
Clearly, for rre = re and H = I, wiiA) and WhiA) are reduced to the classical 
numerical range FiA) in In p.5|) and if A is orthonormal 

iA*A = In), for H = A, clearly 

WhiA) = [0, (^)] = [0,1], wiiA) = [ (A) J ""max (A)] = {1} 

where a"max(0 and <Tnim(') denote the maximum and minimum singular 
values of matrix. Some additional properties of these sets are exposed in 
section 3 including the notion of sharp point. 

Accepted the definition (|1.2p . an equivalent representation of wiA) in 
fOD is 

wiA) ={z £ C : PAQ = zS, where P = yy*, Q = xx* , S = yx* 

and X E C", y G C", ||a;||2 = ||y||2 = 1} 

In (|1.8p the matrices P, Q are rank-1 orthogonal projections of C" and C" 
and S satisfies the equation PXQ = X. In this way, in section 4 we are led 
to the generalization of rank-k numerical range for square matrices 

AJA) = |A G C : PAP = XP for some rank - k 
(1.9) ^ ^ 

orthogonal projection P} 

which has been presented and extensively studied by Choi et aZ in [3] , [1] , [3] , 
[6] and later by other researchers in [16], [H], [l3] and [l2]. In this paper, 
for the m X n matrix A and a positive integer > 1, the rank-k numerical 
range of A is defined by the set 

^ ^ 4>kiA) = {z £ C : PAQ = zS, for some rank — k orthogonal 

projections P and Q and S = PSQ} 

For m = n and P = Q, </'fc(^) = AkiA). 

These sets satisfy, analogously to A^iA), the inclusion relationship 

wiA) = MA) ^ MA) ^...^ MA) 

where r = min{rre,n} and the proof is established in the final section 4. 
Then it is proved that (pi^iA), under constraints for the index /c, is a circular 
ring or a disc, presenting the non-emptiness and the convexity of the set for 
special cases. 
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2 Properties of w{A) 



Recalling the definition of w{A) in (jl.2p . we readily recognize the property 

w{kA) = kw{A). 

The convexity of w{A) is confirmed indirectly by the next statement. 

Proposition 1. For each m x n matrix A, w{A) = {z £ C : \z\ < ||j4||2}. 

Proof. Let m > n. Since the rows oi, . . . , a„ of ^4 are linear dependent, we 
consider the unit vector yo such that y^A = 0. Then, for a unit vector x, we 
have UqAx = 0, i.e. G w{A). Also, due to Cauchy-Schwarz inequality, we 
obtain 

\y*Ax\ = \{Ax,y)\ < \\Ax\\^ \\y\\^ = WAxW^ < max ||^x||2 = ||^||2 = o-max(^)- 

Il^ll2 = l 

li z = re*^ S {z : \z\ < \\A\\2}, obviously < r < ||j4||2. Evenly, there exists 
a unit vector x such that ||^x||2 = r, since the function f{x) = ||^2;||2 : 
Sn — > (0, 11^112] is continuous, where 5„ is the compact unit sphere of C". 
Thus, for y = Ax/{\\Ax\\2e^^), clearly ||y||2 = 1 and 

y*Ax = ."^ "^^n = \\Ax\\r, e'^ = re*^ = z. 
^ WAxW^e-'^^ " 

Moreover, the boundary dw{A) = {z : \z\ = ||j4||2} is attained, since, by 
the unit eigenvectors A* Ax = cr^^x^ and AA*y = cr'^a.^y, we receive the 
point = |y*(o"maxy)| = o'max- Due to the fact that the singular values 

of A and e^^A are identical, the points y*{e^^A)x are also boundary points 
of the circular disc {z : \z\ < ||A||2}. □ 

We remark that the proof is not specially simplified if we consider the 
singular value decomposition of A and the invariant under unitary equiva- 
lence. 

Corollary 2. Let A £ Mm,n o-nd z = y* Ax G w{A). Then we have 



I. z£F{ 



2A 

Onxm 



and corresponds to unit vector = 

II. w{A) = no<e<27r {half plane : e"*^ {z : Rez < cTmax(^)}}, 
III. i/^ = a G C", w{a) = V{0, WaW^). 

Proof. I. By Proposition 1, we have Rez G [— Cmaxl^), Cmaxl^)] and after 

To A] 

some algebraic manipulations, we obtain Kez = uj* u, where uj 
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1 

V2 



Similarly, Im z = lo* 



and consequently z = uj* 



-lA 
iA* 
2A 




UJ, i.e. Imz £ [-icrmax(^) 



UJ. 



II. The graph of dw{A) is constructed only by the values e^^a^a,x{A). 

III. For A = a £ C", the unique singular value of a is cr = ||tt||2- D 

Corollary 3. Let A,Be M.m,n, then holds: 
I. w{A) = w{A*), 

II. w{A) C w{A), for any p x q submatrix A of A, 

III. w{diag{A, B)) = max {w{A),w{B)} , where A e Mm,n, B e Mn,m, 

IV. + B) C + w{B), 

V. ii;(C/*Ay) = w{A), where U £ Aim, V S A4„ are unitary matrices. 

Proof. Statement (I) is an immediate consequence of Proposition 1 and (II) 
is implied using the inequality ||^||2 < ||^||2 ([11]) Cor. 3.1.3, p. 149), where 
A is p X q submatrix of A. Following, assertion (III) can be deduced from 
the condition \\diag{A, B)\\2 = max{||A||2 , II-BII2} and for (IV), (V) the 
triangle inequality and the unitarily invariant property of ||-||2 are applied, 
respectively. □ 

The computation of w{A) from inside is presented by the next proposi- 
tion. 

Proposition 4. Let I, k be positive integers less than m, n, respectively. 
Then 



(2.1) 



w(A) =P 0, max \QArjA: ^ 



where {^1, . . . ,^1} and {ryi, . . . , rjk} are orthonormal vectors of C™ and C", 
respectively. 

Proof. Any vectors x £ C" and y G C™' belong to subspaces Q C" and 
Q C C"^. If {r]i, . . . , ?7fc} and {^1, . . . , ,^/} are orthonormal bases of T and G, 
respectively, then 



x= [m ■■■ y = [(,1 ... C«] V 

\\y\\ = 1, u and v are also unit 



where u G and v £ Since 
vectors and we have 



y*Ax = V* 



A[ni ... i]k]u = V* [i*Ar]j\ ' u. 



5 



Thus, we verify 



^ < PII2 and then the equation ([211]). □ 



Note that in (j2.ip for k = n and [r/i ... Ty^] = /„ we have 

=P(0,„max WE*A\\^), 

where H = [^1 ... . 

For a pair of matrices A,B £ Mm,n the numerical as it has 

been presented in ()1.3p and ()1.4p . imposes the question "how (^4, i?) in 
(jl.4p is independent of B". An answer is given in the next proposition. 

Proposition 5. Let A,B(^ Mm^n such that \\B\\p > 1. Then 

I. IJ u;||.||^(Ai?)=P(0,P||^). 
I|S||^>1 

II. If rankB = k and \\(y\\p > \fk, where the vector a = . . . , a^) 
corresponds to the singular values of B, then the centers of the discs 



Proof. I. Let z G \J^^^^^^y-^w\\.^\^{A,B), then there exists a matrix Bq G 

Mm,n ^ 

Hence, 



Mm,n with \\Bo\\p > 1, such that I < \\A-^^Bo\\F\/l-\\Bo\\f 



(2.2) |.|<KMoM + ||^_i^«„||,;iT^ 

and it suffices to show that the right part of (|2.2p is less than ||^||^. In fact, 
the relationship (||j4||^ — \{A,Bo)\)'^ > is equivalent to 

I" "" " j (1 - lli^oll. ) < [\\A\\p - -j^ j 

Since, \\A\\l-lif^ = \\A-^Bo\\l, we have 
\{A,Bo)\ , „ , {A, Bo 



„R„2 +U-j7rwBo\\F^^i-\\Bo\r/< 

Moreover, if Bq = Ae''^ / \\A\\p, 6 G [0,27r), then \\Bo\\p = 1 and 
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Thus, by (II. 4p we have 



<0 ^ z = \\A\\pe''' => \z\ = \\A\\p 



thereby, the boundary of 2?(0, H^Hp^) is attained. 

II. Denoting by A(-) and (j(-) the eigenvalues and singular values of ma- 
trices and making use of known inequalities pTT, p. 176, 177] it follows that 

\{A,B)\ _ \triB*A)\ _ \EHB*A)\ ^ E\HB*A)\ ^ Z'^jB^A) 

llr?l|2 llDll^ llDll^ 

\\-d\\p W-^Wf W-^Wf W^Wf W-^Wf 



B\\l 



Since ||cj||p, > Vk, then = \W\\f > ^^I^IIf > (1'^) = Yl^iB) 

and consequently by (j2.3p . 

■ 2 — 'Jmaxy-^j — 11^112 • 



□ 



The conclusions of proposition 5 strengthen the definition ■w{A) in ()1.2p 
since the independence of w^\.^\^{A, B) by the matrix B leads to a circular 
disc. 

Proposition 6. Let A G Mm,n, then 

w{A) = {{A,B) : B € Mm,n, rankB = 1, \\B\\p = 1} . 

Proof. Let z G w{A), then there exist unit vectors x £ C", y G C"^ such 
that 

z = y*Ax = tr(y*Ax) = tr(Axy*) = {A, yx*) 
Denoting hj B = yx* , obviously rankB = 1 and 

II-^IIf — tr{B*B) = tr{xy*yx*) = tr{xx*) = tr{x*x) = 1. 

Conversely, if rankB = 1 then B = yx* and evenly {A,yx*) = tr{xy*A) = 
y*Ax. Since, 1 = = tr{xy*yx*) = \\x\\\ \\y\\\^ to the case where x^y 

are not unit vectors, let ||y|| > 1, then ||x|| < 1 and we verify that the point 
y*Ax = ^A^ belongs to w{A). □ 



Example. If A 



, Propositions 5 and 6 are 



6 + i 1/2 
-4 -3 - 6i 

illustrated in the next figure, where the drawing discs (A, B) in (|1.4p . for 
six different matrices B with ||-B||^ > 1, approximate the disc I'(0, ||j4||^). 
The dashed circle is w{A) in (|1.2p . 
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3 Properties of wi{A) and Wh{A) 

In the introduction we have been referred to the numerical ranges wi{A) 
and Wh{A) for rectangular matrices with respect to unitary m x n matrix 

H. Let A= . , (or A = [ ^2 ])j with Ai to be square. Then for 



H 



I 




, by (ir5])-(lL6]) we have 



wi{A) = F{Ai) and Wh{A) = F{[ A 0„x(m-n) ] ), when m> 
and by p.7|) we have 



n 



wi{A) = F{Ai) and Wh{A) = F{ 







A 

{n~m)xn 



), when m < n. 



Proposition 7. Let the vector a = [ ai 02 
with respect to H - 







. Qm ] G C"*, thenwh{a) 
is the elliptical disc with focal points and ai, 



the major axis has length \\a\\2 o,nd the minor axis has length \\b\\2, where 
b=[ 02 ... am]^ ■ 

Proof. By the definition Wh{a) = F([ a Omx(m-i) 
of ei = [ 1 ... ]^ G C"-! 

H = Im-i - 2^, with u = b 

'11 

[ a 



. If b is not collinear 
we consider the Householder matrix 



1(12 



^ei. Then 



1 
H 



1 

H* 



diag 



ai 

IHl2"2 Q 
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Hence, F{[ a O^x(m-i) ]) = F{ 



ai 

|fc|l2l2 
1^ 








and the numerical 



range on the right is the elUptical disc with the aforementioned characteristic 
features. □ 

By Proposition 7, clearly, Wh{a) = {z : \z\ < II&II2}, when ai = 0. More- 
over, if a G Mi^m, it is explicitly viewed that Wh{a) is the same elliptical 
disc. 



Proposition 8. Let m > n and A G M.m,n- If ^ 
the principal n x n submatrix of A, then 

I. wi{A) C Wfi{A) for every unitary H G M.m,n- 
II. w{A)={jHWi{A) = {jHWh{A). 



Ai 
A2 



where Ai is 



III. Rewh{A) = F{ 



niAi) A\I2 

A2II Om~n 



, Im Wh{A) = F{ 



A2/2 



-A\I2 



0. 



with respect to unitary H = 



, where 7Y(-) and S{-) denote the 



hermitian and skew-hermitian part of matrix, respectively. 



IV. a{Ai) C WhiA) C w{A) with H = 



Proof. I. Let the unitary matrix U = [ H R ] ^ M m,nn where H G J^m.n- 
Then 

wniA) = F{AH*) = F{U*AH*U) = F{ [ [j 

whereupon vuiiA) = F{H*A) C Wh{A). 

II. Suppose z G \Jwi{A) = \JjjF{H*A), then for a m x n unitary 
matrix H 



\z\ < r{H*A) < \\H*A\\r^ < \\H* 



I2 II^L — 



where r(-) denotes the numerical radius of matrix. Thereby, [Jwi{A) = 
\JfjF{H*A) C w{A). On the other side, if z = y* Ax G to(^), then there 
exists a m X n unitary matrix H such that y = Hx and z = x*{H*A)x G 
F(H*A). The assertion {Jwh{A) = w{A) is established similarly. 



III. It is enough to confirm that for the mx n unitary matrix H 

Rewh{A) = ReF{[ A ]) = F{n{[ A O])), 







where 'H(-) denotes the hermitian part of matrix. Similarly, for Im Wfi{A). 
IV. We need merely to apply cases (I) and (II) for the m x n unitary 



matrix H = 







□ 



9 



By the definitions (ll.5p . ()1.6p or (II. 7p it is clear that the concept of sharp 
point im p. 50] of F[AH*) or F[H* A) is transferred to the sharp point of 
Wh{A) or wi{A), respectively. Especially, we note: 

Proposition 9. Let A £ Mm.n, m > n and Xq{^ 0) be sharp point of 
Wh{A) = F{AH*) for H e 7W,n,„, H*H = /„. Then Aq G a{H* A) and is 
also sharp point of wi{A) = F(H*A). 

Proof For the sharp point Aq € dwhiA) = dF{AH*) with H*H = /„ 
apparently, Aq G a{AH*) = a{U*AH*U) = a{H*A) U {0}, for the unitary 
matrix U = [H R] £ Mm,m, i.e. Aq G a{H*A) C F{H*A) = wi{A). 

Moreover, for Aq, according to the definition of sharp point, there exist 
6*1, (92 G [0, 27r), 6i < 62 such that 

Re (e*^Ao) = max |Rea : a G e'-^WhiA)^ 

for all 6 G {9i,92)- Since Wh{A) 5 wi{A) we have 

Re (e*^Ao) = max Rea> max Re 6 

for all e G (^1,^2). 

Furthermore, for every 9 G (^1,^2) 

Re(e^^Ao) G Re{e'^F{H*A)) < maxjReft : b G e'''F{H*A)^ 

and thus Re(e*''Ao) = max {Re 6 : 6 G e'^F(/i'M)} for all 9 G (^1,^2), 
concluding that Ao(/ 0) is sharp point of F{H* A) = wi{A). □ 



For m X n unitary matrix H 
corollary. 



we may obviously see the following 



Corollary 10. Let Ai G A4n,n be the principal submatrix of A £ ■M.m,n CLud 
Ao(/ 0) be sharp point of Wh{A) = F{\^A O]). Then Aq G cr{Ai) and is also 
sharp point of wi{A) = F{Ai). 

It is noticed here that the converse of Proposition 9 does not hold as it 



is illustrated in the next figure. If A 



l+i 


-7 





hi 


0.02 











6 - i 












and H 



Aq = 5i is sharp point of wi{A) but not of Wh{A). Note that by are 
denoted the eigenvalues and 5i of AH* . 
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4 The rank-k numerical range 

In this section, initially, we note the easily confirmed properties of (j)kiA) in 
(fTTOD : 

(pkicA) = c(j)kiA), c G C and = (Pk{A). 

Also, in the next proposition we generalize some necessary and sufficient 
conditions [3] for Ak{A) in ()1.9p . which are extended to (pk{^)- 

Proposition 11. Let A G Aim,n- The next expressions are equivalent. 

I. ze <pk{A). 

II. There exist subspaces J C C™ and K, C C" such that dim^7 = dim/C = 
k and {A - zS)IC±J. 

III. There exist orthonormal matrices M G Mm,k o-i^d ^ £ -^n,fc such that 
M*AN = zIk. 

IV. {Av,u) = z {v,u), where v = Nv, u = Mu and M,N are the matrices 

in (III). 

V. There exist subspaces C Q and Q C C" of dimension k, where 
{Av, u) = z \\v\\ \\u\\, for every u ^ C and v £ Q. 

Proof. We prove that (I) is equivalent to (II), (III), (IV) and (V). 

II. For z E (t)k{A), clearly by (fTTO]) P{A - zS)Q = 0. li J = Im{P) C 
and /C = Im{Q) C C", then dimj = dim/C = k and for every x E /C, 

V £ J have 

((A - zS)x,y) = {{A- zS)Qx',Py') = {P*{A - zS)Qx',y') 
= {P{A-zS)Qx',y') = 
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whereupon {A — zS)K,A-J . Conversely, by orthogonahty we have : 

{{A- zS)x,y) =Q M X lC,y J ^ 

{{A - zS)Qx' , Py') = yx',y'^{P{A-zS)Qx',y') = M x' ,y' ^ 

P{A-zS)Q = {)^ ze(t)k{A). 

III. Let the matrices M = [ ui ... Uk ] and N = \^ vi ... f jt ] , 
where their columns Uj, Vi constitute orthonormal bases of J and /C in 
(II), respectively. Then, by statement (II) : 

= {{A- zS)vi,Uj) = {Avi,Uj) - z {Svi, Uj) . 
Denoting hj S = MN* = J2i=i '^I'^h obtain 



{Avi,Uj) = z(^uiViVi, Uj) = 



UjUlVi Vi = z 



1=1 



1=1 



foT I = i = j, and thereby M*AN = zlk- For the converse, by the equation 
M*AN = zlk with M*M = N*N = 4 we have {Avi^uj) = 6ijZ, for i,j = 
l,...,k, where 5ij is the Kronecker symbol. Hence, PAQ = zS, where 
P = MM*, Q = NN* and S = MN*, i.e. z G MA). 

IV. If u = XiUi + . . . + XkUk and v = nivi + . . . + /ifef^, then by (III): 



{Av, u) = u*Av = [ Ai ... Afc ] M*AN 



^1 



= z[ Xi ... Xk 



/il 



z {v, u) . 



Conversely, by the equation {Av,u) = z{v,u), for v = Vi = Nci and 
u = Uj = Mej, where e,, Cj are vectors of standard basis of C*', we have 

{Avi, Uj) = z (ej, Cj) =^ u*jAvi = e*M*ANei = 6ijZ ; i,j = 1, . . . ,k 

or equivalently M*AN = zlk, i.e. z £ (pkiA). 

V. Let z G (j)kiA) and u G span {u2, . . . , ttfe}"*", v G span {v2, . . . , Vk}^, 
where Uj G C"*, Vi G C" are orthonormal vectors. Denoting by 



M 



U2 



N 



V2 



Vk 



clearly M*M = N*N = 1^. By statement (II) and for P = MM*, Q = NN* 
and S = MN* we have {A-zS)g±j(:, where G = Im{Q), L = Im{P). Thus, 
we obtain 



{{A - zS)v, -a) = ^ {Av, u) = z {Sv, u) = z {MN*v, u) = z {N*v, M*u) 
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V V u^u 



z \\v\ 



u 



The converse is received trivially, completing the proof. 



□ 



Proposition 12. The rank-k numerical range (f)k{A) for a rectangular ma- 
trix A e M m n satisfies the relationship 



w{A) = <Pi{A) ^ (t>2{A) 5 
where r = min{m,n}. 



D ct>r{A) 



Proof. Let z G </'fc(^) and u, v are unit vectors of and C". Then, by 
proposition 11(V), we derive {Av,u) = z, i.e. z £ (pi{A) = w{A). Hence, 
4>kiA) C cj)i{A) for every k. Besides, if z £ (pki^), by Proposition 11(111) we 
have M*AN = zlk, where M = [ ui ... Uk ] = [ Mi Uk ] and N = 
[ f 1 ... f fc ] = [ A^i f fc ] are orthonormal matrices. Then M^ANi = 
zlk-i, i.e. z £ (pk-iiA), concluding that (pki^) ^ 4'k-iiA) for = 2, . . . , r, 
where r = min {m, n}. □ 

Following, we present some additional properties : 

Proposition 13. Let A £ M-m,n, then for 4>k{A) in (jl.lO|) . holds: 

I. (j)k{U*AV) = (bkiA), where U £ M m,m and V £ M.n,n ^^'"c Unitary 
matrices. 



II. 4>k{A) = (t)k{e'^A) for every 9 £ [0, 2tt). 



III. If z £ (pki^), then Rez £ Ak{ 





A* 



) = [—CTkyCTk] and Imz £ 



-iA 
iA* 

the decreasingly ordered singular values of A, counting multiplicities. 



) = [—iakjick], where o"i > (T2 > 



> (Tg > denote 



Proof. I. Let z £ (pkiU* AV), then for suitable unitary matrices M £ Mrn,k 
and N £ Mn,k we have M*U*AVN = zh {UM)*A{VN) = zh i.e. 

z £ <l)k{A). Thus <i)k{U*AV) C (j)k{A). 

Conversely, if z G (/>fc(A), then R* AT = zlk, where R £ Mrn,k and 
T £ M n^k &re unitary. Clearly we can write R — UM and T — VN , where 
U and V are defined by orthonormal bases of C™ and C", respectively. 
Therefore, M*{U*AV)N = zh, i.e. z £ (t)k{U*AV). 

II. Assume M £ Mm,k and N £ Mn,k such that M*M = N*N = Ik, 
then 



{z£C 
{z£C 
{z£C 
{z£C 



M*AN = zlk} 
{M*e-'^){e'^A)N = zlk} 
{e'^M)*{e'^A)N = zlk} 
M*{e''A)N = zIk} = Me''A) 



13 



for every 6 G [0,27r), since Mj^Mi = M*M = 4. That is, the set (l)k{A) is 
circular. 

III. By (fTTO]) . let PAQ = zS, where P = MM*, Q = NN* and 5 = 
MN*. Then, M*AN = zlk and consequently 



(4.1) 



iRez)Ik = ^[M* N*] 



M 



' 


A 




"M" 


A* 










Denoting by T = -ij ^ G M^,^+n),k, then T*T = ^{M* M + N* N) = h 

is rank-A; orthogonal 



and the (m+n) x (m+n) matrix G = TT* = ^ 
projector, because rankT = k and 



P S 
S* Q 



1 



■ P2 + SS* PS + SQ 
S*P + QS* S*S + Q^ 



Thus, by gl]) we obtain (Re z)G = G 



Similarly, we derive Im z G 
(m + n) hermitian matrix 





iA* 



1 

4 

A 

A* 



P + P 2S ' 
25* Q + Q 



G, i.e. Re z E Afc( 



G. 

A 

A* 



)■ 



. Moreover, due to the (m+n) x 



A 

A* 



having eigenvalues —ai < —G2 < . • • < 



— fjg < < CTg <...< o"2 < cTi, [TU] and the multiplicity of A = being 

r A 

equal to m + n — 2(7, we verify [BJ Th. 2.4] that Afc( 



A*- 



and Afe( 



■ -iA 
iA* 



□ 



A more precise description of (pkiA) is given in the next proposition. 

Proposition 14. Let A S Mm,n <ind cri > a2 > ■ ■ ■ > (^mm{m,n} be its 
singular values. 

I. If for the index k, maxjy,^} < k < m±^±l^ tfi^n (^^(A) is equal to 
the ring TZ{0;am+n-2k+i,crk)- 

II. Ifk> m±^+l^ then (t)k{A) is the empty set. 

III. If k < max|^)f}; then (j)k{A) is identified with the circular disc 
V{0,ak). 

Proof. I. Consider that A = VEV* is the singular value decomposition 
of A, then by Proposition 13(1), (pkiA) = (pkC^)- If G (pkij^): then for 
suitable mx k and nx k unitary matrices M and A'' we have zl^ = M*TiN . 



14 



Denoting hy U = [M Mi] and V = [N Nij the augmented unitary 
square matrices, then the singular values of matrix 



(4.2) U*T.V 



'M*T.N M*T.Ni 



are also cJi > cj2 > . . . > (yra\n{m,n} ^ud the singular values of submatrix 
M*T.N = zlk are equal to /3i = /32 = • • • = /3fc = \z\. Thus, by Th.l in [15], 
we have 

/^gx CTi > fii = \z\ , for i = l,...,k, 

I3i > ai+rn+n-2k , f or i = 1, miu {2k - m,2k - u} . 

Since k < ind:^±l^ then clearly (Jm+n-2k+i < ffc- The validity of all inequa- 
lities (|4.3|) confirms am+n-2k+i < |^| < (^fe and by the circular property of 
(/>fc(S) in Prop. 13(11) we have that z belongs to the ring 7^(0; am+n-2k+i^ Cfc)- 
Conversely, if z E 7^(0; crm+n-2fc+i) o'fc)) then 

'^min{m,n} < • • • < m+n-2k+l < l^^l < CT k < O'fc-l < • • • < O" 1 

and by Th.2 in [T3], we have that there exist m x k and n x k unitary 
M £ M.m,k and N G A^n.fe such that I3i = . . . = j3k = \z\ are the singular 
values of the submatrix M*T,N in (|4.2|) . Due to the singular values of z/^ 
and M*T,N being identified, the matrices are related by the equation 

Wi{zIk)W2 = M*TN 

where Wi, W2 are kxk unitary matrices. Hence, we have {MWi)*T,{NW2) = 
zlk, yielding that z S (pkC^)- 

Note that, for k = '""'"g =^ ak = am+n-2k+i, i-e. the ring is dege- 
nerated to the circle {z : \z\ = ak}- 

II. If A; > lB±n±l^ then ak < am+n-2k+i and should be z G {z : |z| < crfc}n 
{z : \z\ > crm+n^2k+i} = 0- Therefore, (pki^) = 0- 

III. To the case k < max {y, f }, obviously min{2A; — m,2k — n} < 
and then only inequalities (Ji> f3i = \z\ for i = 1, . . . ,k are valid, establishing 
(i>k{A)=V{Q,ak). □ 

Corollary 15. Let A G Mm,n o,nd cti > ... > (yrD\ii{m,n} singular 
values. If max { y, f } < < "^+3 and ar = 0, for k <r < m+n — 2k+l, 
then (j)k{A) coincides with the circular disc I?(0, cjfc). 

Proof Apparently, by Proposition 14(1), (pkiA) = TZ{0; am+n-2k+i,crk)- Since 
index r satisfies k < r < m + n — 2k + 1, we have 0"^ > > crm+n-2k+i 
and then (pkiA) = P(0,crfc). To the case k = r, Ok = Oj- = and (j)k{A) is 
degenerated to the origin. □ 
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We remark here that if ||^||2 = o"i with multiphcity k, as it is stated in 
Corollary 15, and ai = iov k < I < m + n — 2k + I, then (pkiA) = 'D{0, ai). 
The boundary points of this disc are reached, using the eigenvectors of A* A 
corresponding to af. 

Proposition 16. Let the matrix A G Mm,n- If C is {m — k + 1)- dimensional 
subspace of and Q is {n — k + 1)- dimensional subspace ofC^, then for 
any positive integer k > 1 

M^)^r\'^iPcA) and (PkiA) ^f]wiAQg) 
c g 

where the numerical range w{-) has been defined in ()1.2p and PcQg are 
orthogonal projectors onto C and Q, respectively. 

Proof. Assume z G (j)k[A). By Proposition 11(V) there exist subspaces C 
and Q' of C™ and C", respectively, with dim£' = dim^' = fc, such that 
z = {Av,u) for unit vectors v £ Q' ,u £ C. Then, following the arguments 
in [3], for a unit vector u G £ n £' we readily see that z = {Av,u) = 
{Av,Pcu) = {P^Av,u) G w{PcA), where Pc is orthogonal projector of C™ 
onto £. Hence, 4>kiA) C f]^{w{PcA) : Pc orthogonal projector ontoC}. 

Similarly, considering the subspace Q of dimension n — k + 1 we conclude 
the second inclusion. □ 

Remark. It is worth noticing, finally, the containment 

V{0,ak{A))C n w{AQg)=V{0,mm\\AQg\\^), 

Q 

dimQ=rL—k-^l 

since [HI p. 148] 

min IIAQcllo = minmax |||^Qcx|L : x G C", llxIL = 1) 



> minmax {II^QgxIlg : x £ \\x\\2 = 1} = Cfcl^)- 

g 
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